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Abstract. We consider existence and uniqueness of symmetric approximation of frames 
by normalized tight frames and of symmetric orthogonalization of bases by orthonormal 
bases in Hilbert spaces. A crucial role is played by the Hilbert-Schmidt property of a 
certain operator related to the initial frame or basis. 



Given a Hilbert space H and a linearly independent set of vectors {/}" in H the Gram- 
Schmidt process is traditionally used as a means of creating an orthonormal set of vectors 
{fii}i from {fi}™ in such a way that span{/j}^ = span{/ij}^ for all 1 < k < n. This process 
is inherently order- dependent in that a reordering of generally results in an entirely 
new orthonormal set {yUj}". For some problems in quantum chemistry, it is desirable 
to treat the vectors {/i, f 2 , f n } simultaneously in a method that is order-independent 
instead of successively as in the Gram-Schmidt process. It is also desirable in such ap- 
plications to orthonormalize the set {/i}" in such a way that the sum Y^j=i ll/A? — /ill 2 * s 
minimal. The resulting set {jWj}" is called the symmetric or Lowdin orthogonalization of 

mi 

The original work on this subject was done by Per-Olov Lowdin, a quantum chemist, in 
the late 1940's ([0)- I n later publications by Jerome A. Goldstein and by the coauthors 
J. G. Aiken, J. A. Erdos and M. Levy ([[[], @, |12[) this process was extensively studied. Also, 
symmetric orthogonalization has been linked to the construction of optimal algorithms for 
finding matrix inverse square roots of positive invertible matrices and for computing the 
principal square roots of invertible normal matrices in computer science ([[T§|, |2"1"| , |2"2] , |P7|). 



In his Ph.D. thesis the third author investigated the existence and uniqueness of sym- 
metric orthogonalization of countably infinite linearly independent sets {fi}^ in Hilbert 
spaces H. Introducing the operator F : l 2 — > H, Ffa) = fi for any i 6 N and for the 
standard orthonormal basis {ej}^° of l 2 , he showed the existence of symmetric orthogo- 
nalizations of {fi}^° if (/ — \F\) is a Hilbert-Schmidt operator on l 2 and the dimension of 
the kernel of F is less than or equal to the dimension of the orthogonal complement of 
the range of F. Uniqueness can be guaranteed if and only if the dimension of the kernel 
of F is zero, |2^, Th. 4]. An alternative characterization of a symmetric orthogonalization 
{vi}™ of the set {fi}f is the finiteness of the sum YlJLi \Wj ~~ fj\\ 2 an d its equality to the 
square of the Hilbert-Schmidt norm of the operator (J — \F\), [f23|, Th. 2, 3 and Cor. 5]. 
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However, the identity of the Hilbert (sub-)spaces generated by and respec- 

tively, only takes place if the symmetric orthogonalization is unique, p3| , Cor. 6]. These 
results will be presented in section three of the present paper. Complementary, the third 
author introduced the notion of a weak symmetric orthogonalization, and he showed its 
possible non-uniqueness in all cases by example. 

The concept of frames, i.e. of sets of generators {/ijieN of Hilbert spaces with the 
property that the inequality C ■ \\x\\ 2 < J2jeN K x ' fj)\ 2 — D- \\x\\ 2 is fulfilled for any x G H 
and two constants C, D > 0, generalizes the notion of a basis for Hilbert spaces. Frames 
play an important role in wavelet theory and its applications to signal processing, image 
and data compression or analysis, and others ( ||24j| ). Note that in infinite-dimensional 
spaces the concepts of frames and bases of Hilbert spaces do not coincide any more since 
some bases lack the frame property, see Example |3 . 1| . 

The goal of the present paper is to investigate the existence and uniqueness of symmetric 
approximations of frames (respectively, symmetric orthogonalizations of bases of Hilbert 
spaces) {/i}igN of Hilbert subspaces K C H. That means, we look for the existence 
and uniqueness of normalized tight frames (resp., orthonormal bases) {z^}j g N of Hilbert 
subspaces L C H such that the sum ^] JgN — fj\\ 2 is finite and admits the minimum of 
all finite sums Ylj^n Wf^j ~ /ill 2 that m ight, appear for any other normalized tight frame 
(resp., orthonormal basis) {/ijjjgN of any other Hilbert subspace of H. We apply the 
approach of the third author to symmetric approximations of frames in Hilbert spaces by 
normalized tight frames. We can rely on fundamental work done by David R. Larson and 



his collaborators Xingde Dai, Deguang Han, E. J. Ionascu and C. M. Pearcy ([[K], [13], |l6f), 
by A. Aldroubi §, P. G. Casazza §, O. Christensen 0, § § and J. R. Holub |TJ, [T§. 
As a result we obtain that a symmetric approximation exists and is always unique if and 
only if the operator (P — \F\) is Hilbert-Schmidt, where (I — P) denotes the projection 
to the kernel of \F\. For the detailed explanations we refer to section two. 

Section one is devoted to an alternative proof of the existence and uniqueness of the 
symmetric approximation of finite frames in subspaces of Hilbert spaces that remodels 
the proof given by the third author for the case of finite bases. Some obvious changes 
appear because of the in general non-trivial kernel of the operator F. 



I. Symmetric approximation of a finite frame in a subspace 

Let if be a Hilbert space and {/? }ieN C H be a frame in a separable Hilbert subspace 
K C H, i.e. there are two constants C, D > such that the inequality 

C-\\x\\ 2 <J2\(xJi)\ 2 <D-\\x\\ 2 

holds for every x G K C H and every finite or countable index set. Without loss of gen- 
erality we consider only finite and countable frames in this paper. In case of uncountable 
frames there are no principal changes. If C — D then the frame is said to be tight, if 
C — D — 1 then it is said to be normalized tight. If for two frames {/i}i G N and {gi}im 
of two Hilbert subspaces K and L of H, respectively, there exists an invertible bounded 
linear operator T : K — >• L such that — gi for any index i then these two frames are 

said to be weakly similar. If K = L then the frames are called similar. A Riesz basis of 



SYMMETRIC APPROXIMATION OF FRAMES AND BASES IN HILBERT SPACES 



3 



a Hilbert space K is a basis of K that is a frame at the same time. Riesz bases are pre- 
cisely the images of orthonormal bases under invertible linear operators, [|13|, Prop. 1.5]. 
A frame is said to be a near-Riesz basis if the deletion of finitely many elements from the 
frame leads to a set that is a Riesz basis of the Hilbert space generated by the frame. 
P. G. Casazza and O. Christensen constructed in |], Prop. 2.4] a tight frame of a sepa- 
rable Hilbert space that is not a near-Riesz basis. Other examples have been found by 
K. Seip p0 |. However, any frame of a finite-dimensional Hilbert space is near-Riesz. For 



the details of the separable case we refer to the end of section two. 

Definition 1.1. A normalized tight frame {vi}™ in a finite-dimensional Hilbert subspace 
L C H is said to be a symmetric approximation of a finite frame in a Hilbert 

subspace K C H if the frames {/i}" and {^i}™ are weakly similar and the inequality 



/<, - ./:, 2 > Z • u 



is valid for all normalized tight frames {yUj}™ in Hilbert subspaces of H that are weakly 
similar to {/j}™. 

If the frame is a system of linearly independent vectors then the set {^}™ will 

become a symmetric orthogonalization of {/i}™, i.e. an orthonormal system, as will be 
shown below. For finite frames {fi}f =1 of a Hilbert subspace K C H we have dim(i^) < n 
since the reconstruction formula shows the property of a frame to be a set of generators of 
K. Let {e{\i be the standard orthonormal basis of C n and define an operator F : C n — > H 
by the formula 



E 
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a j e j I Zj a jfj 



0=1 / 3=1 

The operator F has a natural polar decomposition F = W\F\, where W is a partial 
isometry from C n into H with initial space ker(F)- 1 - C C n and range K C. H, cf. [|i~3| 
Prop. 1.10]. In particular, F possesses a closed range and the set {W^(ej)}" is a normalized 
tight frame in K C H , cf. [|13|, Cor. 1.2. (i)] . So the frames and {^(ej)}" span 

the same Hilbert subspace K C. H. We want to show that the normalized tight frame 
{Pv"(ej)}" in K is a symmetric approximation of our initial frame. To proceed we need 
the following fact characterizing the Hilbert-Schmidt norm of operators on H. 

Lemma 1.2. Let T be a bounded linear operator on a Hilbert space H and let {h i } i( z$ 1 and 
{^i}iej2 ^ e t wo normalized tight frames of H. If one of the sums in the following equality 
is finite then the identity ^ JgJ j 1 ||^(^-i)|| 2 = Sjejj 2 ll-^(^i)ll 2 holds. If there exists at least 
one normalized tight frame of H for which the sum is finite then T is a Hilbert-Schmidt 
operator and the square root of the sum equals its Hilbert-Schmidt norm ||T|| C2 . 
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Proof. Let {t>i}iei be an orthonormal basis of the norm-closure of the range of T in H. 
Since T(hj) £ ran(T) we have 

jeSi jeli i& ieJi iei 

= E E k t >*)> ^-)i 2 = E E Kn^), ^-)i 2 

12 



Eh t * 



iei 

The sums are all at most countable (or they are equal to infinity) since a Hilbert-Schmidt 
operator is compact and, hence, its domain and codomain are at most separable Hilbert 
subspaces. Since the same calculations are true for the other normalized tight frame 
we obtain the desired equality. □ 

Note that the number of elements in the normalized tight frames, and hence the di- 
mension of H, can be finite or infinite. Moreover, if the frames are finite then they can 
contain different numbers of elements. Along the way we have obtained an interesting new 
formula for the calculation of the Hilbert-Schmidt norm of a Hilbert-Schmidt operator. 
The proof of the next theorem is a modification of the analogous proof for the symmetric 
orthogonalization of finite sets of linearly independent elements C H by the third 

author, |23|, Th. 1]. (An alternative proof for this special case can be found in 0.) 



Theorem 1.3. Let {fa}™ be a normalized tight frame in a Hilbert subspace L C H and 
let {fi}i be a frame in a Hilbert subspace K C H such that both these frames are weakly 
similar. Using the notations introduced after Definition \1. i| the inequality 

n n 

E iia* - ^i 2 ^ E n^fo) - ^ii 2 = ik j - i f dii 2 2 - N 

holds for N = dim(ker(|F|)). Equality appears if and only if \ij = W(ej) for every 
j = 1,2, ...,n. Consequently, the symmetric approximation of a frame {fi}i in a finite- 
dimensional Hilbert space K C H is a normalized tight frame spanning the same Hilbert 
subspace L = K of H and being similar to {fi}™. 

Proof. Let {/Xi}™ be a normalized tight frame for some Hilbert subspace L C H . Define 
G : C n — > H by Cr(ej) = fa for 1 < i < n. Note, that G is a partial isometry by 
fl3| , Prop. 1.1]. Since \F\ is compact it possesses an orthonormal basis of eigenvectors 



{hi}™ C C n with eigenvalues {Aj}™. By Lemma [L^ we can proceed with the following 
calculations: 



E ii^ -/ill 2 = Eii^-^i^Eii^-w)^. 

j=i j=i j=i 



3)f 



n n 
3=1 3=1 



\\(G - W\F\){h 3 )r = J2 - XjW(hj 



We point out that the ranges of the (isometric) frame transforms G* and F* of the frames 
and {fj}i, respectively, coincide in C n since the frames were supposed to be weakly 
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similar, cf. |13], Cor. 2.8]. Therefore, the kernels of G and F also coincide. For eigenvalues 
Aj 7^ of \F\ we have the following lower estimate: 

\\G(hi) - \iW(hi)\\ 2 = HGWII 2 - 2A i Re(G(/ ii ), W%)) + A 2 ||W^)|| 2 

= ||G*G(/i,)|| 2 - 2X l Re(G(h l ), Wfc)) + A 2 ||W(^)|| 2 
= l-2\ t Re(G(h l ),W(h l )) + \ 2 l 
> 1-2A, + A 2 = (1-A,) 2 
for every i = 1, 2, n since hi € ker(G)- L = ker(W) 1 - and 

Re<G(/i i ),W(/i<)) < |(G(/ii), W(/i<))| < \\G(hi)\\\\W{hi)\\ = \\G*G{hi)\\ \\W(hi)\\ =1 . 

For eigenvalues Aj = the term simply equals to zero. As a consequence we get the 
inequality 

n n 

valid for iV = dim(ker(|F|)) and for any normalized tight frame {/ii}™ in a Hilbert subspace 
L (1 H that is weakly similar to the frame {/i}" in iT. To express the lower estimate in 



two other ways we transform it further using Lemma 1.2 



j=l j=l j=l 



T,^ 1 - \ F \)( h M 2 = - 1*1)1 



C2 



3=1 
n 



E ik j - I^IX^II 2 = E w w v - i*m-)ii 2 + n 

3=1 3=1 



II 



= e - i^D^oir +^=e ii^fe) - /iii 2 + n . 

i=i i=i 
Summing up we get the estimate 

n n 

E ii^ - ^'ii 2 ^ E ii^fo) - h\\ 2 = ik j - ™i - * 

i=i i=i 

that is valid for every normalized tight frame {/Xi}" in Hilbert subspaces L of H which is 
weakly similar to the frame {fi}™- 

Finally, we show uniqueness. Suppose, {/ij}™ is a normalized tight frame in a Hilbert 
subspace L of H that realizes the equality YTj=x ll/^j — /ill 2 = Sj=i ll^( e i) — /ill 2 an d is 
weakly similar to the frame {/i}"- Then Re(G(/ij), W(/ii)) = 1 for each i e {1, 2, n} 
with Aj 7^ 0. (If Aj = then Gfc) = W(hi) = 0.) Since the inequality 

1 = Re<G(^), W(/ii)> < |<G(/ii), W(/ii))| < 1^(^)1111^(^)11 = 1 

holds for every eigenvector hi with non-zero eigenvalue Aj we conclude G(/ij) = aiW(ei) 
for certain complex numbers «j 7^ and i G {1, 2, n} by the Cauchy-Schwarz inequality. 
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Replacing G{hj) we obtain 1 = (G(hi),W(hi)) = ati(W(hi),W(hi)) = CKj for every i G 
{l,2,...,n}. Therefore, Gfc) = W{hi) for i G {l,2,...,n} forcing G = W since {h^ 
has been selected as an orthonormal basis of eigenvectors of \F\ in H. This gives the 
desired result /ij = Wfe) for every i G {1,2, ...,n}, and the Hilbert subspaces L and if 
coincide. □ 

Let us remark that in case {fi}™ is a linearly independent set of elements in H then 
{W(ei)}i has to be linearly independent, too, since the linear span of both these sets 
coincides in H and is a linear subspace of dimension n. In this case \F\ has no kernel. 

2. Symmetric approximation of frames in separable Hilbert spaces 

Let if be a separable Hilbert space and {/j}jgN be a frame in a Hilbert subspace K C H. 

Definition 2.1. A normalized tight frame {^}j e N hi a Hilbert subspace L C is said to 
be a symmetric approximation of {/i}ieN if it is weakly similar to {/t}ieN, the inequality 

oo oo 

is valid for all normalized tight frames {ni}a^ in Hilbert subspaces of H that are weakly 
similar to {/j}«eN, and the sum at the right side of this inequality is finite. 

Again we do not assume that both frames {/ijigN and {z^jieN span the same Hilbert 
subspace of H . Theorem |27| will show that they do. We note that every set {/ij}i G N that 
is quadratically close to a frame {/i}igN of some Hilbert subspace of H (i.e. for which 
J2j Wfj — 9j\\ 2 < °°) has to be a frame of the Hilbert subspace spanned by it, too, cf. [|[ 
Th. 3]. However, it is not automatically weakly similar to the original frame since the 
position of possibly existing zero elements in these sequences matters. So we cannot 
sharpen our definition on the general level. 

Let {ej}j g N be the standard orthonormal basis of the separable Hilbert space li- Given 
a frame {/i}jgN of a Hilbert subspace K C H we define the operator F : I2 — > H by the 
formula 

3=1 

The operator F has a natural polar decomposition F = W\F\, where If is a partial 
isometry from I2 into H with initial space ker(F) ± C l 2 and range ran(F)~ C H, cf. [|l3l 
Prop. 1.10]. In particular, F has closed range and the set {W(ei)}jgN is a normalized 



tight frame of a separable Hilbert subspace of H, cf. |13| , Cor. 1.2(i)]. If we simply try to 



repeat the steps of our considerations in the previous section we run into difficulties. 

Example 2.2. Let H — l 2 with the orthonormal basis {ej}j £ M- Set F(e\) = and 
F(ei) = aj_iej_i for a sequence of complex numbers {aj} ig N and any i > 2. The set 
{/i}«eN = {F(ei)} ie fq becomes a frame for the Hilbert space H if and only if both 

inf |«j| 2 > , sup I cti 1 2 < +00 . 



ieN 
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This guarantees the boundedness and surjectivity of F. Then |F|(ei) = and |P|(ej) = 
|ctj_i|ej for every i > 2, and consequently W(e\) = and W(ei) = a,i-\/\a,i-\\ ej_i for any 



> 2. By Lemma |1.2| the operator (J — \F\) is Hilbert- Schmidt if and only if the series 



converges. As can be easily seen the choice «j = const ^ 1 leads to a infinite Hilbert- 
Schmidt norm and to a situation in which the operator (J — \F\) is definitely not Hilbert- 
Schmidt. Beside this, even if a choice of the coefficients {aj}j g N would give rise to a 
Hilbert-Schmidt operator (/ — \F\), the operator F has still a non-trivial but finite- 
dimensional kernel by construction. Note also, that the frame {/i}ieN is not a Riesz 
basis of H since it contains the zero vector as its first element. 

For other examples the kernel of F can be infinite-dimensional. To see this take an 
orthonormal basis {ej}j g N of the Hilbert space l 2 and consider the normalized tight frame 
{fi}ien f° r a subspace of l 2 defined by f 2i = e 2i , f 2 i+i = 0. This frame is its own symmetric 
approximation. However, the kernel of the operator F is infinite-dimensional since the 
frame contains countably many zero elements. 



Theorem 2.3. Let {/j}« e M be a frame of a Hilbert subspace K of the Hilbert space H. 
Denote by P the projection of H onto the (norm-closed) range of the operator F* F . Then 
the operator (P — \F\) is Hilbert-Schmidt if and only if the sum YlfLiW^j ~ /ill 2 ^ s finite 
for at least one normalized tight frame {/ij}i £ N of a Hilbert subspace L of H that is weakly 
similar to {fi}i^n- In this situation the estimate 

YZJk - £H a - £Zi ||w(ei) _ fjf = ll(p _ 

is valid for every normalized tight frame {/ijjjgN of any Hilbert subspace of H that is 
weakly similar to {fi}ien- (The left sum can be infinite for some choices of {fa}^.) 

Equality appears if and only if fa = W{ej) for any j 6 N, where W is the partial 
isometry of the polar decomposition F = W\F\ and {ej}j g N is the orthonormal basis of 
H used to define the operator F. Consequently, the symmetric approximation of a frame 
{/i}iGN i n a Hilbert space K C H is a normalized tight frame spanning the same Hilbert 
subspace L = K of H and being similar to {fi}ien- 

Proof. Suppose (P — \F\) is Hilbert-Schmidt. Then it is compact and possesses an or- 
thonormal set {hi}i<zfq of eigenvectors with corresponding non-zero eigenvalues {Aj}j 6 N- 
This set forms a basis of the Hilbert subspace (J — P)(H). Complete this basis of 
(I-P)(H) to a basis of H by adding a basis {hfi im of P(H). Note, that (P-|F|)(^) = 
for any index i. 

Let {/^j}igN be a normalized tight frame of a Hilbert subspace L C H that is weakly 
similar to the frame {/«}jeN- Define G : l 2 —>■ H by G{e,i) = fa for i G N and an 
orthonormal basis {ei}^ of l 2 . Then G is a partial isometry with the same kernel as W 
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and \F\, cf. [|13| , Cor. 2.8]. Then by Lemma |TT2^ we have the following equality: 



j=i j=i j=i 



A 2 



oo 

|2 



E \\(G - ^IFD^OH 2 + ^2\\(G- W\F\)(h' k 
j=i fceN 



k) 



(2) = ^HG^-A^Of + O. 

i=i 

Since Aj 7^ for any index i we have the following lower estimates: 

\\G(hi) - X l W(h i )\\ 2 = ||G(/i 4 )|| 2 - 2X i Re(G(h i ), W{K)) + A 2 ||W^)|| 2 

= \\GTG{hi)f - 2A,Re(G(/i l ), W{h t )) + A 2 ||W(^)|| 2 

= l-2\ i Re{G{h i ),W{h i )) + \ 2 i 

(3) > l-2A i + A 2 = (l-A l ) 2 

since 

^B{G{hi),W{hi)) < \(G(hi),W(hi))\ < 11^(^)1111^)11 = \\G*G(hi) \\ \\W(hi)\\ = 1 . 
Therefore, we get the estimate 



E IK- - ^i 2 ^ £(* - A ^) 2 = E n( p - \ F \)( h M 2 = \\( p - \ p \ 
j=i j=i j=i 



which is valid for all normalized tight frames {fa}^ being weakly similar to {/i}ieN- 
Obviously, the special choice /i, = Wfa) for i e N gives the equality 



IC2 



E 11^') -/,n 2 = 11(^-1^ 

by equality (0). Uniqueness can be shown in the same way as in Theorem [05 



Let {/Xj}jgN be a normalized tight frame in a Hilbert subspace L of H that is weakly 
similar to the frame {/«}ieN and for which the sum Y^JLi W^j ~ fj l| 2 is finite. Consider the 
operator T : l 2 — > H defined by T(e«) — Hi-fi for the fixed orthonormal basis {ei} ie ^ of 
l 2 - Then 



T (E,- a J' e 1| - E,-N ' 11^ ~ ^'11 - IK a i}jllyE-ll^' ~ ^'11 2 < 



OO 



for any sequence {ctij-j G Z2 an d, hence, T can be approximated by finite rank operators 
in norm on l 2 . So T = G — F is compact for G(ei) = fa, (i G N). Counting F*F = 
I — T*G — G*T + T*T we see that F*F equals the identity operator minus a compact one 
and, hence, must be diagonalizable on l 2 . So \F\ is diagonalizable, too. 

Let be an orthonormal system of eigenvectors with non-zero eigenvalues of \F\, 

let {h'^ifzfq be an orthonormal basis of the kernel of \F\. Repeating the calculations (0) 
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and (0) we arrive at 



°°>Z>j-/:,-|| 2 > HO?" 1^1 

3=1 



and the operator (P — \F\) is Hilbert-Schmidt, where P denotes the projection of I2 onto 
the kernel of \F\. □ 

Corollary 2.4. Let {fi}ien be a frame of a Hilbert subspace K of the Hilbert space H . 
Denote by P the projection of H onto the (norm-closed) range of the operator F*F. If 
the operator (P — \F\) is not Hilbert-Schmidt then the sum X/Jlill^j — fj\\ 2 is infinite for 
any normalized tight frame {//i}ieN of a Hilbert subspace L of H that is weakly similar to 
{fi}i&i- I n other words, there does not exist any symmetric approximation of the frame 
{fi}ien- 

Corollary 2.5. If a frame {fi}ien of an infinite-dimensional Hilbert subspace K of a 
Hilbert space H is a Riesz basis and it has a symmetric orthogonalization in H by an 
orthonormal basis {z^jjeN of a Hilbert subspace L of H then the operator (I — \F\) is 
Hilbert-Schmidt and the estimate YsjLilWj ~~ fj\\ 2 < 00 holds. Moreover, the more general 
estimate YlJLi \\f i j~fj\\ 2 > II (I~ 1-^1) \\l 2 ^ s va lid for any infinite orthonormal basis 
of any separable Hilbert subspace of H and, in particular, \F\ is injective. 

If the operator (I — \F\) is Hilbert-Schmidt then the Riesz basis {fi}im admits a unique 
symmetric approximation by the orthonormal basis {W(e$)}i e N of the same Hilbert sub- 
space of K C H . 

Conversely, if in this case the operator (I — \F\) is not Hilbert-Schmidt then the sum 
YujLi Wl^j ~ fj\\ 2 i s infinite f° r an y orthonormal basis {yUj}i S N of any separable Hilbert 
subspace of H . 



A reference to Definition |2.1| and to Theorem |0| makes the corollaries obvious. 

Recall, that a frame {/ijigN is said to be a near-Riesz basis if there is a finite set 
a for which the set {/j}j e N\o- is a Riesz basis of the (separable) Hilbert space K C H 
generated by the initial frame. Near-Riesz bases have a number of alternative equivalent 
characterizations: 

(i) the kernel of the derived operator F : I2 — > H is finite-dimensional and has 
dimension card(cr), (|TJ, Th. 2.4, 3.1]), 

(ii) the sequence {/j}ieN is Besselian, i.e. whenever J2jen c jfj converges in K then 
{<:}, ,: ■: (0 Th. 2.5]), 

(iii) J2jm c jfj converges in K if and only if the sequence of coefficients {cj} ie N 
belongs to l 2 , ([TJ, Th. 2.5]), 

(iv) the sequence {/i}igN is unconditional, i.e. whenever J2jen c jfj converges for a 
sequence {cj} ie N of numbers then it converges unconditionally, ( JT4] , Th. 3.2] 
and H, Th. 3.1]). 

In case the frame {/i}igN is a near-Riesz basis we can formulate another corollary the 
formulation of which already predicts the result for general bases of infinite-dimensional 
Hilbert subspaces. 
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Corollary 2.6. Let {fi}i^n be a near-Riesz basis of a Hilbert subspace of H. Then this 
frame possesses a symmetric approximation {vi}^ if and only if the operator (I — \F\) 
is Hilbert- Schmidt. In this situation the frame {z^}j<=N is also a near-Riesz basis and the 
adjoint operators F and G of the corresponding frame transforms of both these frames 
have kernels of the same dimension (i.e. both these frames have the same excess). In fact, 
their kernels coincide. 



Proof. By |H| the operator F has a finite-dimensional kernel if and only if the frame 
{fi}i&i is a near-Riesz basis. However, in case of a finite-dimensional kernel of F the 
operator ( I — \F\) is Hilbert-Schmidt if and only if (P — \F\) is. So Theorem |2l| implies 
the main equivalence of the corollary. The operators F and W = G have the same kernel 
since W* is an isometry and ranF = ranW 7 as shown above. Hence, the normalized tight 
frame {W( e »)}*eN has to be a near-Riesz basis, too. □ 

Corollary 2.7. If for a frame {/j}jgN of a Hilbert space K the operator (I— \F\) is Hilbert- 
Schmidt then the frame is a near-Riesz basis and admits a symmetric approximation. 

3. Symmetric orthogonalization of arbitrary linearly independent sets 

of elements 

The considerations below are part of the Ph. D. thesis of the third author. For a 
different treatment of the infinite situation we refer to [T|]. 

Let {/i}igN be an infinite set of linearly independent elements of a (separable) Hilbert 
space H and let {ei}^ be an orthonormal basis of 1%. Consider the linear operator F 
defined by F(ei) = /, for ieN. Since the set {/i}ieN may lack the frame property for the 
Hilbert subspace K C H generated by it the operator can in general be unbounded and 
can possess a non-trivial kernel. 

Example 3.1. Let fi — e\ + for i > 2 and fi = e\ for a fixed orthonormal basis 
{ei}i e N of the Hilbert space l 2 . Then F maps the element x n = Y^=ij~ le j m t° F( x n) — 
YTj=i J~ le i + Y^ n j=2J~ le r F° r n — > oo the sequence {x n } ng N converges in norm, whereas 
the sequence of images {F(x n )} nS N diverges to infinity on the multiples of the first basis 
vector e\. Therefore, the operator is not everywhere defined on I2 and unbounded. 



Example 3.2. To give an example of an operator F with non-trivial kernel consider 
the linearly independent set {fi = — — l)ej_i,/i = ei}j £ N constructed from an 
orthonormal basis {ej}j<=N of li- The derived operator F : — > fi is bounded since 



\ 1 1 — -voo 



~ a j e j 



< 3 



Eoo 



Consider the element x = YlJLij l& j an( i its image F(x). An easy calculation shows that 

forcing F(x) =0 for n — > 00. As an immediate consequence we obtain that the sequence 
{fi}icN is not a frame in the Hilbert space spanned by it. Note, that the operator (J— |-F| 2 ) 
is not Hilbert-Schmidt because Lemma |0| applied to the basis {ej}j S N gives an infinite 



SYMMETRIC APPROXIMATION OF FRAMES AND BASES IN HILBERT SPACES 



11 



Hilbert-Schmidt norm. Since (J — \F\ 2 ) = (I — \F\)(I + \F\) and the Hilbert-Schmidt 
operators form an ideal the operator (J — \F\) also cannot be Hilbert-Schmidt. 

To give a reasonable definition of symmetric orthogonalization(s) of infinite sets of 
linearly independent vectors {/i}jgN C K C H we have to suppose that the derived 
operator F is at least bounded. This condition does not depend on the choice of the 
orthonormal basis in I2, but only on the set {/i}ieN C H. 

Definition 3.3. An orthonormal basis {j/j}»eN for a Hilbert subspace L C H is said to 
be a symmetric orthogonalization of {fi}i & n if the inequality 



is valid for all orthonormal sets {/ijjigN in Hilbert subspaces of H and the sum at the 
right side of this inequality is finite. 

Proposition 3.4. Let {fj}^ be an infinite set of linearly independent elements of a 
Hilbert space H and let {e^}^ be an orthonormal basis ofl^- Consider the linear operator 
F defined by Ffa) = fi for i e N. 

If (I — \F\) is Hilbert-Schmidt then Yl'jLi ll/f? — fj\\ 2 — 11-^ — l-^IIIJL f or °^ orthonormal 
subsets {/ijjieN of H. 

IfYlJLi H/Aj ~~ /ill 2 < 00 f or some orthonormal set {/ijjigN then the operator (I — \F\) is 
Hilbert-Schmidt and the estimate YlJLi Wf^j ~ fj\\ 2 — \\I ~ l-^1llc 2 ^ s va ^d. 

Proof. Let {f^i}^ be a countable orthonormal subset of H and {ej}j g N an orthonormal 
basis of l-i. Define the operator G : I2 — > H by G(ei) = \Xi for i 6 N. Then G is an isometry. 
If (J — \F\) is supposed to be Hilbert-Schmidt then there exists an orthonormal basis of 
eigenvectors of the operator \F\ in l 2 denoted by {/^}j G N with corresponding eigenvalues 
{Aj}j e N. Moreover, since (I—\F\) is supposed to be Hilbert-Schmidt the operator (\F\ —I) 
is compact and, hence, the operator \F\ = I + (\F\ —I) is Fredholm. Therefore, the kernel 
of \F\ has to be finite-dimensional. Without loss of generality, let {hi, h^} be the 
eigenvectors corresponding to eigenvalues zero of \F\, where N = dim(ker(|F|)) > 0. By 
Lemma |1.2| we have the following equality: 



00 




i=i 3=1 



00 



DC 



OO 



iiG(ci) - = E ik g - ^i F i)( e i)ii 2 




00 



00 



(4) = ^||(G'-W|F|)(/ ii )|| 2 = E||G(/ ii )-A i ^(/ ii )|| 2 . 
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since 

Re(G(/i l ),W(/ ii )) < !<<?(/*), W^/iO)! < \\G{hi)\\ || W(hi) || = 1 . 
Therefore, we get the estimate 



E iim* - £H 2 ^ D 1 - x tf = E ik j - i^ix^ii 2 = ik j - 1*1 
j=i j=i j=i 

which is valid for all orthonormal subsets {/ij}j e N C H. 

Now, suppose the finiteness of the sum Y^jLi Wf^j ~ /ill 2 f° r some orthonormal subset 
{fJ>i}i€N °f H. Consider the operator T : l 2 — > H defined by T(ei) = — /, for the fixed 
orthonormal basis {ei} ie N of Z 2 . Then 



t (E 3 . a J e i) || ^ Ejl a J'l ' 11^' ~ £H - IK a iblly Ej-H^ ~~ < 00 

for any sequence G / 2 and, hence, T can be approximated by finite rank operators 

in norm on l 2 . So T = G — F is compact for G(ej) = /ij, (z G N). Counting F*F = 
/ — T*G — G*T + T*T we see that F*F equals the identity operator minus a compact one 
and, hence, must be diagonalizable on l 2 . So \F\ is diagonalizable, too. 

Let {/ij}jgN be an orthonormal system of eigenvectors of |F| with eigenvalues {Aj} i€ N. 
Repeating the calculations @ and (||) we arrive at 



oo>J2\\^-fi\\ 2 >W(I-\F\ 

i=i 

and the operator (J — |F|) is Hilbert-Schmidt. Its Hilbert-Schmidt norm satisfies the 
desired inequality. □ 

Example 3.5. We give another example demonstrating that even the condition on 
(I — \F\) to be Hilbert-Schmidt does not guarantee that ker(|F|) = {0}. Let H = l 2 
with 

1 ( \ \ n_1 n 1 / 1 \ n ~ J+1 l 

/ 1 = e 1 , /2 = 7 =(e 1 + e 2 ), /ri =^j e x - £ ) * + e n forn > 3 . 

Obviously, the set {/j}jgN is linearly independent in l 2 by construction. Representing F 
as an infinite matrix and counting the entries of the infinite matrix that represents F*F 
as scalar products of column vectors we obtain 

(/-I^| 2 )(ei) = -E(7fj e,,(/-|F| 2 )( ei ) = -(^=J ei for*>2. 



Applying Lemma [L~2| for the orthonormal basis {ej}j g N we get a finite value for the Hilbert- 



Schmidt norm of the operator (I — |-F| 2 ): ||(J — |-F| 2 )|| C2 = y/2. Since 

oo oo 

w - \mi = E(! - A ^) 2 ^ X> - ^i)^ 1 + x ^ = ik j - i f i 

i=i i=i 



2\ i|2 
/ Ilea 



SYMMETRIC APPROXIMATION OF FRAMES AND BASES IN HILBERT SPACES 



13 



(where {Aj}j g N are the eigenvalues of |F|) we conclude that the operator (I — |F|) is 
Hilbert-Schmidt, too. 

Consider the element x = —e\ + E J l 2 (v / 2) _(j_1) ei that belongs to l 2 since its norm 
is ||x|| = y/2. Counting the value of |F| 2 (x) we obtain x G ker(|F| 2 ). The equality 
|||F|(x)|| 2 = (\F\{x), \F\(x)) = (\F\ 2 {x),x) = forces \F\(x) = 0. 

The next theorem demonstrates that {/jjigN does not possess a symmetric orthogonal- 
ization. 



Theorem 3.6. Let {fi}^ be a linearly independent set of a (separable) Hilbert space H 
such that the derived operator (I — \F\) is Hilbert-Schmidt. Then there exists a symmetric 
orthogonalization {ui} ie ^ of this set in H if and only if dim((ranF) ± ) > dim(kerF). In 
this case, setting v { — (V + W){ei) for i 6 N, with an orthonormal basis {ei}^ of l 2 
and any partial isometry V : l 2 — > H with initial space ker|F| and ranV _L ranW = ranF 
yields a symmetric orthogonalization. Moreover, all symmetric orthogonalizations arise 
in this way. 

The set {fi}ien possesses a unique symmetric orthogonalization {vi}.^ if and only if 
kerF = {0} ; if and only if the sets {ui\ ie m and {fi)im span the same Hilbert subspace 
of H. In this case, = W(ej) for any i 6 N and V = 0. In other words, the linearly 
independent set {fi}i e n is a frame (and, therefore, a Riesz basis) for the Hilbert subspace 
it spans if and only if kerF = {0}. 

Proof. Let us first show that ranF = ranVT, i.e. that ranF is actually closed. Since 
(7 — \F\) was supposed to be Hilbert-Schmidt the operator \F\ is Fredholm and his range 
ran|F| is closed by the definition of Fredholm operators. Let y n = F(x n ), (n G N), form 
a Cauchy sequence in ranF, where {x n } ne ^ G l 2 . Then for every e > there exists a 
number iV such that \\y m — y n \\ < e for all m, n > N. Therefore, 

£ > WVm-VnW = ||F(a: ro -a; n )|| = ||W|F|(a: m - x n )\\ = |||F|(a; m - x n )|| 

since \F\(x m — x n ) G (kerlFl)- 1 belongs to the initial space of W. So the sequence 
{|F|(x„)} ne N is a Cauchy sequence in ran|F|. However, ran|F| is closed and, hence, 
there exists a z G ran|F| and a x G l 2 such that \F\(x) = z = lim n \ F\(x n ). Then 

limy n = limF(x„) = lim W|F|(a; n ) = W(lim|F|(a: n )) = W\F\(x) = F(x) 

n n n n 

and ranF is shown to be closed and to coincide with the range of the partial isometry W. 

Suppose dim((ranF)- L ) > dim(kerF). If kerF = {0} then let V = on l 2 . If kerF ^ {0} 
then it has to be finite- dimensional since |F| is Fredholm and ker|F| = kerF. Suppose, 
is an orthonormal basis of kerF. Since dim((ranF) ± ) > n by assumption we can 
select another orthonormal set {pi}™ C (ranF) -1 and define V(£j) = Pi for % = l,...,n. 
Then V is an isometry for elements of ker|F|. On (kerjFD^ we set V to be the zero 
operator. Consequently, ranV _L ranH^, \\(V + W)(x)\\ = \\x\\ for every x G l 2 and the 
set {(V + W)(e,i)} i£N is an orthonormal set for the orthonormal basis {ej} ie N of l 2 . Since 
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(V + W)\F\(x) = F(x) for every x G I2 we obtain the equality 

00 00 

52\KV + W){e j )-f j \\ 3 = ^\\(Y + W)(I-\F\)(e 

3=1 3=1 

00 

3=1 



By Proposition |3.4| the estimate 



E 11^' - /ill 2 ^ 11 ( J - i f dii c 2 2 = E 11 ( y + ^)( e i) - ^ii 2 

i=i i=i 

is valid for any orthonormal subset {/Uj}j 6 N of H. Therefore, we have found a symmetric 
orthogonalization of the linearly independent subset {/i}«eN C H inside H . 

To show the converse, assume dirn((ran.F) ) < dim(kerF) and the existence of a sym- 
metric orthogonalization {z/j} ie N of the set {/i}ieN in H. Setting G(ei) = Vi for i G N we 
obtain an isometry G : I2 — > H. Consequently, 

00 00 

\\G ~ F\\l 2 = E KG - F)(e,)f = E - /if < 00 

3=1 j=l 

by the definition of a symmetric orthogonalization. So the operator {G — F) is compact 
and Hilbert-Schmidt. Since (/ — \F\) was assumed to be Hilbert-Schmidt the kernel 
of F is finite-dimensional, and so is (ranF)- 1 by assumption. Hence, F is Fredholm 
and G = F + {G — F) is Fredholm, too, by the compactness of (G — F). Moreover, 
the indices of G and F coincide and are greater than zero by assumption. However, 
ind(G) = dim(kerG) — dim((ranG) ) = — dim((ran(j) ) since G is an isometry. So we 
arrive at a contradiction: dim((ranG) ± ) < 0. The only possible conclusion is the non- 
existence of a symmetric orthogonalization in case dim((ranF) ± ) < dim(kerF). 

We want to know more about the canonical form of symmetric orthogonalizations in 
case at least one exists. First of all, if {z^}^ is another symmetric orthogonalization of the 
linearly independent set beside the orthonormal set {{V + W)(ei)} i£ ^ constructed 

above we have the relation 



11 ( j - 1*1) us, = E \\( v + w )^)f * E ii"i - /: 
3=1 3=1 



,„ 2 =lia-|*l)llc 2 



by Proposition |3.4| . Let G : I2 — > H again be the isometry defined by G(ei) = for 
i G N. The goal of the subsequent considerations is to establish that (G — W) is actually 
a partial isometry with initial space ker|F| and, hence, Ui = ((G — W) + H / )(e i ) for i G N, 
where (G - W) = V. 

Let x G ker|F|. Then \\(G - W)(x)\\ = \\G(x)\\ = \\x\\. So the operator (G - W) acts 
on ker|F| as an isometry. We want to show that G = W on (ker^l)- 1 . Let {/ijjjgN be 
an orthonormal set of eigenvectors of \F\, let {Aj}j e N be the corresponding sequence of 
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eigenvalues. In analogy to the considerations at (|J) and (]5|) we conclude 

oo oo oo 

j=l j=l j=l 

oo 

3=1 

oo oo 
3=1 3=1 

= IKz-I^DIi- 

thus, E"i II (G - W(^-)ll 2 = E"i(! - which im P lies Rfi(W,^))) = i 

and, consequently, G(hj) = W(hj) for any eigenvector /i,- with non-zero eigenvalue Aj. 
Hence, G = W on (ker^l)- 1 since the eigenvectors of \F\ with non-zero eigenvalues form 
a basis of this subspace. 

Finally, we verify that ran(G — W) _L ranPF. Let Z\ E ran(G — W), z 2 E raniy. There 
exist ti,t 2 E l 2 such that (G — W)(t\) = z%, W(t 2 ) = z 2 . Furthermore, tj = Xj + ?/j with 
Xj G ker|F|, ?/j G (ker|F|) and % = 1,2. Now 

(«i,2a> = ((G-W){x 1 + y 1 ),W(x 2 +y 2 )) = (G(x 1 ),W(y 2 )) 
= (G{x 1 ),G{y 2 )) = (x 1 ,y 2 ) = 

since H^(xi) = W(x 2 ) = 0, = W(yi), G(y 2 ) = W(y 2 ) by the location of x i: yi and 

the established properties of W, G. This shows the orthogonality of the ranges of (G — W) 
and W. 

To establish uniqueness conditions we first note that ker|F| = {0} implies V = and, 
hence, the uniqueness of the symmetric orthogonalization {W(ei)}i^. In this case the sets 
{^}ieN and {/j}jgN span the same Hilbert subspace of H. Suppose now, dim(ker|F|) = 
n > 0. Let be an orthonormal basis of ker|F|. Since the assumed existence of 

a symmetric orthogonalization of {/i}igN i n H implies dim((ranF) ± ) > dim(kerF) we 
can choose an orthonormal set {pi}™ in (rani* 1 )- 1 . Define V\ : l 2 — > H by Vi(£i) = Pi for 
i = 1, n and V 1 = on (ker|F|)\ and K 2 : Z 2 -> # by 1/ 2 = -V t . Then i/< = (Vi + W)^) 
and i/- = (V2 + W)(ei), (i EN), are symmetric orthogonalizations of {/j}^. If we assume 
uniqueness of the symmetric orthogonalization then the equalities U{ = v[ for i E N lead 
to the contradiction pi = —pi = for all i EN. This proves the theorem. □ 
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